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Abstract 



The regularity lemma of Szemeredi asserts that one can partition every graph into a bounded 
number of quasi-random bipartite graphs. In some applications however, one would like to have 
a strong control on how quasi-random these bipartite graphs are. Alon, Fischer, Krivelevich 

^^ ■ and Szegedy obtained a powerful variant of the regularity lemma, which allows one to have an 

C) ■ arbitrary control on this measure of quasi-randomness. However, their proof only guaranteed to 

(-H , produce a partition where the number of parts is given by the Wowzer function, which is the 

"t^ I iterated version of the Tower function. We show here that a bound of this type is unavoidable 

by constructing a graph H , with the property that even if one wants a very mild control on the 
quasi-randomness of a regular partition, then the number of parts in any such partition of H 

^\i . must be given by a Wowzer-type function. 

>: 

^ ; 1 Introduction 

r~>^ ■ The regularity lemma of Szemeredi |23j is one of the most widely used tools in extremal combina- 

^— ^ ■ torics. The lemma was originally devised as part of Szemeredi's proof of his (eponymous) theorem 

|22j on arithmetic progressions in dense sets of integers. Since then it has turned into a fundamen- 
tal tool in extremal combinatorics, with applications in diverse areas such as theoretical computer 
S^ ■ science, additive number theory, discrete geometry and of course graph theory. We refer the reader 

j^ ■ to [H] and its references for more details on the rich history and applications of the regularity 

lemma. 

Let us turn to formally state the regularity lemma. For a graph G = {V, E) and two disjoint 
vertex sets A and B, we denote by eG{A,B) the number of edges of G with one vertex in A and 
one in B. The density dG{A^ B) of the pair (A, B) in the graph G is 
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dG{A,B) = eG{A,B)/\A\\B\, (1) 

that is, dciA, B) is the fraction of pairs {x,y) G Ax B such that (x, y) is an edge of G. For 7 > 0, 
we say that the pair {A, B) in a graph G is j-regular if for any choice of A' C A of size at least 
^\A\ and B' C B oi size at least 7|i?|, we have {dciA' ,B') — dGiA,B)\ < 7. Note that a large 
random bipartite graph is 7-regular for all 7 > 0. Thus we can think of 7 as measuring the quasi- 
randomness of the bipartite graph connecting A and B; the smaller 7 is the more quasi-random 
the graph is. We will sometimes drop the subscript G in the above notations when the graph G we 
are referring to is clear from context. 

Let Z = {Zi, . . . , Zk} be a partition of VJG) into k sets. Throughout the paper, we will only 
consider partitions into sets Zi of equal sizqj. We will refer to each Z £ Z as a cluster of the 
partition Z. The order of a partition is the number of clusters it has {k above). We will sometimes 
use |-Z| to denote the order of Z. We say that a partition Z = {Zi, . . . ,Zk} refines another partition 
Z' = {Z[, . . . , Z'l^,} if each cluster of Z is contained in one of the clusters of Z'. 

A partition Z = {Zi, . . . , Zk} of V{G) is said to be 7-regular if all but ^k'^ of the pairs {Zi, Zj) 
are 7-regular. Szemeredi's regularity lemma can be formulated as follows: 

Theorem 1. (Szemeredi [23]) For any 7 > and t there is an integer K = K{t,^) with the 
following property; given a graph G and a partition A of V{G) of order t, one can find a ^-regular 
partition B ofV{G) which refines A and satisfies \B\ < K. 

Let T{x) be the function satisfying T(0) = 1 and T{x) = 2 '^"^^ for x > 1. So T{x) is a tower 
of 2's of height x. Szemeredi's proof of the regularity lemma p3] showed that the function K{t, 7) 
can be bounded from abovcl by T(l/7^). For a long time it was not clear if one could obtain 
better upper bounds for K(t,'j). Besides being a natural problem, further motivation came from 
the fact that some fundamental results, such as Roth's Theorem [ElEO], could be proved using 
the regularity lemma. Hence improved upper bounds for i^(i, 7) might have resulted in improved 
bounds for several other fundamental problems. In a major breakthrough, Gowers [9] proved that 
the Tower-type dependence is indeed necessary. He showed that for any 7 > there is a graph 
where any 7-regular partition must have size at least T(l/7-'^'-'^^). 

Gowers' lower bound [9j can be stated as saying that if one wants a regular partition of order k, 
then there are graphs in which the best quasi-randomness measure one can hope to obtain is merely 
l/(log*(fc))"'^^. Suppose however that for some / : N 1— )• (0, 1), we would like to find a partition of a 
graph of order k that will be "close" to being /(A;)-regular. Alon, Fischer, Krivelevich and Szegedy 
[1] formulated the following notion of being close to /(fc)-regular. 



^In some papers partitions of this type are called equipartitions. 

■^We note that in essentially any application of Theorem [U one takes t to be (at least) I/7 so some papers simply 
consider the function K' [■y) = K(l/'y,'y). The reason is that one wants to avoid "degenerate" regular partitions into 
a very small number of parts, where most of the graph's edges will belong to the sets Vi where one has no control on 
the edge distribution. 



Definition 1.1. ((e, /)-regular partition) Let f be a function / : N i— )• (0,1). An (e, f) -regular 
partition of a graph G is a pair of partitions A = {Vi : 1 < i < k} and B = {Ui^i' : 1 < i < 
k,l < i' < i} of V{G), where B is a refinement of A (with Ui j' C Vi), satisfying the following: 

1. B is f{k)-regular. 

2. Say that a pair {Vi,Vj) of clusters of A is good if all but at most ei'^ of pairs 1 < i',j' < £ 
satisfy \d{Ui^i',Ujj') — d{Vi,Vj)\ < e. Then, at least (1 — e)(2) of the pairs {Vi,Vj) are good. 

One useful way of thinking about the above notion is to "forget" for a moment about the 
partition B and just treat partition A as an /(/c)-regular partition. One then tries to extract some 
useful information from the assumption that A itself is /(/c)-regular. Finally, one uses the second 
property of Definition ll.H which says that the two partitions are similar, in order to show that the 
information deduced from the assumption that A is /(A;)-regular can actually be deduced from the 
fact that B is /(/c)-regular. 

One of the main results of [1] was that given a graph G and any function /, one can construct 
an (e, /)-regular partition of G of bounded size. This version of the regularity lemma is sometimes 
referred to as the strong regularity lemma. As we have mentioned above, in order to avoid degenerate 
partitions we will assume henceforth that an (e, /)-regular partition has order at least 1/e. 

Theorem 2. (Alon et al. [1]) For every e > and / : N i— )• (0, 1), there is an integer S = S{e, f) 
such that any graph G = {V,E) has an (e, f) -regular partition {A,B) where 1/e < |^|, \B\ < S. 

Let us describe two cases where one needs to have a better control of the measure of quasi- 
randomness of a regular partition. A first example is when proving certain variants of the graph 
removal lemma [20] . In such a scenario we are given a regular partition and would like to be 
able to say that since the partition behaves in a quasi-random way, then we can find "small" 
subgraphs that we expect to find in a truly random graph. The only problem is that as the "small" 
structure we are trying to find becomes larger, we need the measure of quasi-randomness to decrease 
with it. Some examples where Theorem [2] was used to overcome such difficulties can be found in 
[H [21 m [5l [131 [H] . We note that in some of these papers, Theorem[2]was used with functions / that 
go to zero extremely fast, so the ability to apply the theorem with arbitrary functions was crucial. 

Another example when one wants a better control of the measure of quasi-randomness is when 
the graph we are trying to partition is very sparse. It is not hard to see that for the notion of 
7-regularity to make sense, the graph should have density at least 7. A well known case where one 
is faced with increasingly sparse graphs is in the proofs of the hypergraph regularity lemma, that 
were obtained independently by Gowers [11], by Rodl et al. [8l[l71[l8] and later also by Tao [21]. In 
those proofs, one is partitioning not only the vertices of the hypergraph (as in Theorem [T|) but also 
the pairs of vertices into quasi-random bipartite graphs. However, in the process these bipartite 
graphs become sparser so one needs to control their quasi-randomness as a function of their density. 
Out of the aforementioned proofs of the hypergraph regularity lemma, Tao's proof actually uses 



Theorem [2] in order to address this issue. See the survey of Gowers [TT] for an excellent account of 
this. 

We finally note that the strong regularity lemma is also related to the notion of the limit of 
convergent graph sequences defined and studied in [7]. Without defining these notions explicitly, 
we just mention that many of the results mentioned above which were proved using Theorem [21 
were later reproved using graph limits, see e.g. Lovasz and Szegedy [16]. Furthermore, some of 
the important properties of the limit of a convergent graph sequence, such as its uniqueness |15j . 
also hold for (e, /)-regular partitions, see [3]- Hence, one can view an (e, /)-regular partition as the 
discrete analogue of the (analytic) limit of a convergent graph sequence. 

Let W{x) be the function satisfying W{0) = 1 and W{x) = T{W{x — 1)) for x > 1. So 
the function W is an iterated version of the Tower function T[x). The function W is sometimes 
referred to as the Wowzeo function (for obvious reasons). The proof of Theorem [2] in [1] gave a 
VF-type upper bound for the function S'(e, /) in Theorem [2j As we have mentioned above, in some 
applications of this lemma one uses functions / that go to zero extremely fast. But in some cases, 
as was the case in [T], one uses moderate functions like /(x) = 1/x^. However, even when the 
function / is /(x) = 1/x, the upper bound given in [1] for the function 5(e, /) is (roughly) l^(l/e). 
Hence it is natural to ask if better bounds can be obtained for such versions of Theorem [2l Our 
main result here is that a VF-type dependence is unavoidable even in this case. 

Theorem 3. Set f{x) = 1/x. For every small enough e < cq there is a graph H with the 
following property: If {A,B) is an {e, f) -regular partition of H, anci |-^| > 1/e, then \A\ > 
W{^\og{l/e)/100). 

An interesting aspect of our proof is that it gives the same lower bound even if one considers 
a much weaker condition than the second condition in Definition 11.11 What we show is that the 
lower bound of Theorem [2] holds even if one wants only e^'^^k"^ of the pairs {Vi,Vj) to be good. 
Observe that Definition 11.11 askaj for (1 — e)(2) good pairs! In other words, the lower bound holds 
even if one is interested in having a very weak similarit}o between the partitions A and B. 

Another interesting aspect of the proof of Theorem [3] is that by resetting the parameters appro- 
priately, one can get W-type lower bounds for (e, /)-regularity for any function / : N i— )• (0, 1) going 
to zero faster that l/log*(x). Observe that this is not a caveat of the proof; when /(x) = l/log*(x). 
Theorem [1] can be formulated as saying that any graph has an (e, /)-regular partition of order 



■^This name was coined by Graham, Rothschild and Spencer |12j . 

^As we have mentioned before, in order to rule out degenerate partitions (such as taking a partition into 1 set) 
we assume that |^| > 1/e. A similar assumption was used in [1], where they assume that f{x) < e. These two 
assumptions are basically equivalent (recall that f{x) — 1/x), but the one we use makes the notation somewhat 
simpler. 

^We note that the application of Theorem[2]in 1^ (as well as in most other papers) critically relied on the partition 
having (1 — e)^^) good pairs. 

^Recall the discussion following Definition ll.il 



r(l/e^). Hence, one cannot obtain a H^-type lower bound for / of this type. So we see that even 
if one wants to have a very weak relation between the order of A and the regularity measure of B 
(say, l/loglog(/e)) one would still have to use a partition of size given by a T^-type functioELl- 

The ideas we use here in order to prove Theorem [3] appear to be useful also for proving VF-type 
lower bounds for the hypergraph regularity lemma [H [lOl [TTl [T71 [181 IS]- As we explained above, 
in this case also one is faced with the need to control a measure of quasi-randomness approaching 
0, and this seems to be the main reason why the current bounds for this lemma are of W^-type. 
This investigation is part of a joint work of the second author with Dellamonica and Rodl. 

Organization: The rest of the paper is organized as follows. In the following section we describe 
the graph H which we use in proving Theorem [3l In Section [3] we give an overview of the proof, 
state the two key lemmas that are needed to prove Theorem [3] and then derive Theorem [3] from 
them. In Section H] we prove several preliminary lemmas that we would later use in the proofs of 
the two key Lemmas. In Sections [5] and [6] we prove the key lemmas stated in Section [3l 

2 A Hard Graph for the Strong Regularity Lemma 

In this section we describe the graph H which will have the properties asserted in Theorem [3l The 
description will be somewhat terse; the reader can find in Section [3] an overview of the proof of 
Theorem [3l which includes some intuition/motivation for the way we define H. 

2.1 A weighted reformulation of Theorem [3] 

Suppose P is a weighted complete graph, where each edge (x, y) is assigned a weight dp{x, y) € [0, 1]. 
For two sets A, B define the weighted density between A, B 

dp{A,B)= Yl dp{x,y)/\A\\B\ . (2) 

Note that if we think of a graph as a weighted complete graph with 0/1 weights then the above 
definition coincides with the definition of dciAjB) given in ([T|). Also note that when A = {x}, 
B = {y} are just two vertices then dp{A, B) is just the weight dp{x^ y) assigned to (x, y) as above. 
The following simple claim follows immediately from a standard application of Chernoff 's inequality. 

Claim 2.1. Let C, > Q. Suppose P is a weighted complete graph with weights in [0, 1], and H is a 
random graph, where each edge {x, y) is chosen independently to be included in H with probability 
dp{x,y). Then with probability at least 1/2 we have 

\dH{A,B)-dp{A,B)\<C, 
for all sets A, B of size at least 20C~^ log(n). 



^But in such cases the bound might become Ty(loglog(l/e)) or some other W-type function. 



It is clear that we can prove Theorem [3] by constructing an arbitrarily large graph, such that the 
number of vertices n will be much larger than all the constants involved. Hence, by the above claim, 
we see that in order to prove Theorem [3] it is enough to construct a weighted graph H satisfying 
the condition of the theorem with respect to the notion of d{A,B) defined in ([2]). The reason is 
that by Claim 12.11 if we have a weighted graph H satisfying Theorem [3l then a random graph 
generated as in Claim [2T] will satisfy the assertion of Theorem [3] with high probability. Therefore, 
from this point and throughout the paper we will focus on the construction of a weighted graph H 
satisfying the condition of Theorem [3l Hence, from now on, whenever we talk about d{A, B) we 
will be referring to the weighted density between A, i? as in ([2]). 

2.2 A preliminary construction 

In this subsection we describe the first step in defining the graph H of Theorem [3l This graph will 
be a variant of the graph used by Cowers in [9j. We start with the following definition. 

Definition 2.2. (Balanced Partitions) Let M he an integer and suppose we have a sequence 
{Ai,Bi)"^-^ of (not necessarily distinct) partitions of [M]. We call this sequence of partitions bal- 
anced if for any distinct j, f € [M] , the number of 1 < i < m for which j and f lie in the same 
set of the partition {Ai, Bi) is at most Sm/A. 

The following claim appears in |9]. For completeness, we will reproduce a simple proof later on 
in the paper (see Section HD . 

Claim 2.3. Let (j){m) = 2'"^'^^'. Then for every m > I there exists a sequence of m balanced 
partitions of (f){m). 

Let T't'{x) be the function satisfying r'^(O) = 1 and T't'{x) = T'f'{x - l)(/)(r'^(x - 1)) for x > 1, 
where 4'{x) = T'^'^^^ is the function defined in Claim 12.31 It is not hard to see that T'^ is a 
Tower-type function, and that in fact T'^{x) > T{[x/2\) (see Section H]). 

Let us define a sequence of integers as follows. We set 

u;(l) = Lloglog(l/e)J , (3) 

and define inductively 

w{x + 1) = Lloglog(T<^(ii;(x)))J . (4) 

It is also not hard to see that w{x) has a M^-type dependence on x. Specifically we will later (see 
Section HD observe that: 

Claim 2.4. For every integer x >1, we have w{x) > iy([x/2j). 

We now turn to define a graph G, which we will later modify in order to get the actual graph H 
that will satisfy the assertion of Theorem [3l In order to define G we will first define a sequence of 
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partitions of the vertex set of G. For simplicity we will identify the n vertices of G with the integers 
[n]. So let n G N and set s = w{-^^/log(T/e)), where w{x) is the function defined in ^. We set 
mo = 1 and for 1 < r < s, let rrir = 77ir-i0(mj._i). For each < r < s, let X|^ , Xg , • • • ,Xml be 
a partition of [n] into rrir intervals of integers of equal sizqj. We will later refer to this partition as 
canonical partition Vr- Thus at level r, we have a canonical partition Vr consisting of vrir clusters. 
So Vq is just the entire vertex set of G. Note that using the notation we introduced above we have 

\Vr\ =mr = T^{r) . (5) 

A crucial observation that will be used repeatedly in the paper is that for every r < r' , partition 
Vr' refines partition Vr- 

We finally arrive at the actual definition of G. We will start with the graph G where each pair 
of vertices (x,y) has weight 0. We will then go over the partitions Vi,V2-, ■ ■ ■ ^Vg one after the 
other, and in each case increase the weight between some of the pairs {x,y). 

Consider some r > 1 and focus on Vr and Vr-i- Let us simplify the notation a bit and set 
m = rrir-i, M = (j){m) and rrir = Mm. So m is the number of clusters of Vr-i, M is the number 
of clusters of Vr inside each cluster of Vr-i, and mM is the number of clusters of Vr- Let us use 
Xi, . . . , Xm to denote the m clusters of Vr-i- Also, for each 1 < i < ?tt, we use Xj^i, . . . , X-i^m to 
denote the M clusters of Vr inside X^. Now, for each 1 < i < m,, let {A[ •, B[ ,)^i be a sequence of 
balanced partitions of [M]. Such a collection exists since M = (p{m) so Claim [231 can be used here. 
One can think of each of these partitions as partitioning the clusters of Vr within cluster Xi. Let 
Aij = UffzA'. Xi^t and Bij = Uf^zB' Xi^t = X;\Aij. We now update the weights of G as follows: If 
{x,y) G Xj X Xj, then we increase dG{x,y) by 4~^/4v ^°s{i/<:) [f g^^^ Qj^jy jf (^x,y) G Aij x Aj^i or 
{x,y) G Bij X Bj^i. We will later refer several times to the following observation. 



Fact 2.5. For any x,y £ V{G) we have dcix^y) < 4-Vi°g(iA). 

2.3 Adding Traps to G 

We will now need to modify the graph G defined above in order to obtain the graph H from Theorem 
El To this end we will need to define certain quasi-random graphs. Let b' < b and consider two of 
the canonical partitions Vb' and Vb defined in the previous subsection. Suppose Vb has order nib 
and let V^ be a set of mb vertices, where we identify vertex i £ V with cluster Xi G Vb- Note that 
with this interpretation in mind, one can think of a cluster U G Vb' as a subset of vertices U' C V, 
where vertex j belongs to U' if and only if cluster Xj G "Pf, is a subset of U. It follows that for every 
b' < b, partition Vb' defines a natural partition of V into mb' subsets C/^ , . . . , C/^ , corresponding 
to its mb' clusters. 



We assume that n is such that it can be divided into equal sized parts of size rrir for all < r < s. 



We now arrive at a critical definition. We will use e{R, R') to denote the number of edges in a 
graph with one vertex in R and another in R', where edges in Rn R' are counted twicqj- 

Definition 2.6. (Trap) Let Vb, rrih, V and the partitions f/f , . . . , C/!^ , be as above. Let O = {V, E) 
be an rrib-vertex graph on V . Then O is said to be a trap if it satisfies the following two conditions: 

• For every pair of sets R, R' C V{0) of size [->/ 7715/4] we have 



e{R,R')-^\R\\R'\ 



<\\R\\R'\. 



For every b' < b, for every 1 < i,j < rrib' , every choice of 200 < k < log{mb), every choice of 
R ^ Ul' of size k^ and every choice of R' C Uj of size \\U^ |/fc], we have 



e(R,R')--\R\\R'\ 



<^\R\\R'\ 



We will later prove the following (see Section H]). 

Claim 2.7. There is a constant C, such that for every m > C, there exists a trap on m vertices. 

We are now ready to describe the modifications needed to turn G into the graph H. We do the 
following for every integer 1 < 5 < ^A/log(l/e); let b = w{g) be the integer defined in (JH, let mi, 
be the order of Vb and let Of, = {V, E) bqlj a trap on a vertex set V of size mb. Recall that we 
identify vertex i £ V with cluster Xi G Vb- We now modify G as follows; for every pair of clusters 
{Xi,Xj), if {i,j) £ E{Ob) we increase by 4~^ the weight of every pair of vertices {x,y) G Xj x Xj. 
If {i,j) E{Ob) we do not increase the weight of {x,y). Let us state the following fact to which 
we will later refer. 

Fact 2.8. The smallest weight used when placing a trap in H is 4~48V °s( /e)_ 

Later on in the paper we will say that we have placed a trap on partition Vb if b is one of the 
integers w{l), . . . ,w{^y^log{l/e)). If a trap was placed on Vb and {i,j) is an edge of the graph 
Ob that was used in the previous paragraph, then we will say that the pair {Xi,Xj) belongs to the 
trap placed on Vb. Also, if b = w{g), then we will refer to the trap placed on Vb as the 5*^ trap 
placed in H. Finally, if {x,y) £ Xi x Xj and {Xi,Xj) belongs to the trap placed on Vyj(g\ then we 
will say that (x, y) received an extra weight of 4~^ from the g trap placed in H. 



^Note that this definition is compatible with the definition of e{A, B) we used earher, where we assumed that the 
sets A, B are disjoint. 

^°Note that since we only ask Theorem [3] to hold for small enough e, we can assume that e is small enough so 
that already mu,(i) = T'^{w{l)) would be larger than C, thus allowing us to pick a trap via Claim [2?7l (where U'(l) is 
defined in dS])). 



Using the above jargon, we can thus say that in order to obtain the graph H from the graph 
G we do the following for every 1 < g < ^A/log(l/e); setting b = w{g), we place the g^^ trap on 
partition Vh, by increasing the weight of {x,y) by 4^^ if and only if (x,y) G Xj x Xj and {Xi,Xj) 
belongs to the trap. 

Let us draw some distinction between the way we assigned weights to edges in G and the 
way we have done so when modifying G to obtain H. When defining G we looked at each of 
the partitions Vr, and for every Xi,Xj G Vr-i added weight 4~^/4v ^°s(i/':) Qj^jy ^q gome of the 
pairs {x,y) £ Xi X Xj. More specifically, we considered the partitions of Xi = Aij U Bij and 
Xj = Aj^i U Bj^i and only added the weight 4~''/4v^°^^^ when either (x, y) G Aij x Aj^i or 
{x,y) G Bij X Bj^i. When adding the traps, we have only added weights to some of the partitions 
Vh, that is, those for which b = w{g) for some 1 < 5 < 70 Y^log(l/e). Moreover, when placing a 
trap on Vh we added weight 4~^ only to pairs (x,y) connecting some of the pairs {Xi,Xj) (those 
that belong to the trap). Finally, for each such pair {Xi,Xj) we either added more weights to all 
the pairs (x, y) £ Xi x Xj or to none of them. 

Another important distinction is the following; suppose b = w{g). Then in G, the weight that 
was added to Vb was 4~''/4V^°g(^/^) while the weight we added when placing a trap on Vb is 4~^. 
Since u; is a VF-type function we see that the weights assigned in G to a specific partition Vb are 
extremely small compared to those assigned to Vb when placing a trap on it (assuming a trap was 
placed on Vb)- 

We also observe that for every pair of vertices (x, y) of H^ the total weight it can receive from 
all the traps we placed is bounded by 1/4 + 1/16 + . . . < 1/3. We also recall Fact 12.51 stating 
that the total weight assigned to a pair (x,y) in G is bounded by l/4v '°g(i/'^). This means that 
dH{x-,y) < 1, as needed for the application of Claim [2Tl 

3 Proof Overview, Key Lemmas and Proof of Theorem [3] 

Our goal in this section is fourfold; give an overview of the proof of Theorem [3l describe the 
main intuition behind the construction of H, state the two key lemmas that will be used to prove 
Theorem [3] and finally derive Theorem [3] from these two lemmas. 

Perhaps the best way to approach our construction of H is to first consider the proof of Theorem 
[2]in [1]. For simplicity, let us consider the case /(x) = 1/x; we start by taking ^1 to be an arbitrary 
partition of G of order 1/e, and then apply Theorem [1] in order to find a l/|^i [-regular partition, 
;Bi, of G which refines ^1. Note that by definition, Ai and Bi satisfy the first condition of Definition 
II. H so if they also satisfy the second, then we are done. If they do not, then we set A2 to be Bi 
and use Theorem[T]to find a l/|^2|-i'egular partition, B2-, of G which refines A2- Note that A2 and 
B2 satisfy the first property, so if they satisfy the second we are done. The process thus goes on till 
we end up with a pair of partitions Ai, Bi which satisfy the second condition. The main argument 
in [1] shows that this process must stop after (about) 1/e steps with a pair Ai, Bi which satisfies 
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the second condition, and also (by definition) the first condition. Since the above proof appHes 
Theorem [1] repeatedly, where each time we take I/7 to be the order of the previous partition, the 
bound we obtain is of W-type. 

Of course, if we want to have any chance of proving Theorem [3l we need to come up with a 
graph for which the proof of Theorem [2] will produce a partition of W-size. Given the overview of 
this proof described above, the graph H needs to have two properties: (1) For every 7 > 0, any 
7-regular partition of H has size given by a Tower-type function; (2) one needs to iteratively apply 
Theorem [1] a super-constanll^^l number of times in order to get two partitions A and B satisfying 
the second condition of Definition 11.11 The first property will guarantee that each time we apply 
Theorem [1] we get a Tower- type increase in the size of Ai while the second condition will guarantee 
that we will have to repeat this sufficiently many times. 

Let us describe how to get a graph satisfying property (1) mentioned above. Recall that Gowers 
showed [9] that for every 7 there exists a graph with the property that any 7-regular partition has 
a size r(l/7"^' "^^). It is not hard to see that by a minor "tweak" of his construction^^ one can get a 
single graph that works for all 7 bounded away from 0. This is basicalljo the graph G we defined 
in Subsection 12.21 For completeness let us describe the intuition behind Gowers' construction. 
Let us explain why the partitions Vr used in the construction of G cannot be used as 7-regular 
partitions of G. Recall that at each iteration, we take every pair of sets Xi,Xj G "Pr-i split them 
as Xi = Aij U Bij and Xj = Aj^i U Bj^i and increase the weight between Aij,Aj^i and Bij,Bj^i. So, 
in some sense, each partition Vr is used in order to rule out the possibility of using the previous 
partition Vr-i as a 7-regular partition. We note that when one comes about to actually prove that 
no other (small) partition can be 7-regular one relies critically on the fact that the weights assigned 
to the partitions Vr in G decrease exponentially (as a function of r). This makes sure that any 
irregularity found in level r cannot be canceled by weights assigned to levels r' > r. 

Let us describe how to get a graph satisfying property (2) mentioned above. Recall that G was 
defined over a sequence of partitions Vr- Suppose we want to make sure that two specific partitions 
in this sequence Vr and Vr' , with Vr' refining Vr , will not satisfy the second property of Definition 
II. 1[ Then we can do the following; we take a random graph O whose vertices are the clusters of 
Vr', and for every edge {i',j') € E{0) increase the weight of all pairs {x,y) £ Ui' x Uji, where 
Ui',Uj' G Vr'- This is just the trap we used in Subsection 12.31 Since we use a random graph, we 
expect all pairs of clusters (Xi,Xj) of Vr to not be good (in the sense of Definition 1 1.1|) since close 
to half of the clusters (Ui', Uj') with Ui' C Xi, Uj' C Xj, will get an extra weight while the other 
half will not. Now it is not hard to see that for this to work we do not actually have to put the 



^^To be precise, in order to get a PF-type lower bound the number of iterations needs to be larger than W ^(1/e). 

^■^In fact, we will be tweaking the construction of Gowers [9j which gives a slightly weaker lower bound of 
r(log(l/7)), and is much simpler to analyze. Since we are trying to prove W-type lower bounds it makes little 
difference if we are iterating the function T{x) or r(log(a;)). 

^^If we were only interested in getting a graph that for all 7 > had only 7-regular partitions of Tower-size, then 



we could have used the weights 4 '' instead of 4 '"/4V '"sCi/"!) Jikg we do. 
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trap on "P^'i it is enough to do that on some partition Vb with r <b <r'. Since we will make sure 
that a 7-regular partition must be huge, in order to satisfy the first condition of Definition 11.11 one 
would have to pick two partitions Vr', Vr with r' being much larger than r. Therefore, in order to 
make sure that all pairs Vr' 1 Vr will fail the second condition, it is enough to place the traps only 
on very few partitions Vh-, where by few we mean that there will be a Tower-type jump between 
their indices. 

So with one serious caveat, if one wants to construct an (e, /)-regular partition by taking A 
and B to be two of the canonical partitions Vr ,Vr' , then one is forced to take two partitions that 
refine the last trap we have placed in H. The reason is that by property (1) the integers r and r' 
must be very far apart, and the way we have placed the traps will guarantee that there will be a 
trap in between them which will then make sure that they do not satisfy the second property of 
Definition ll.il The caveat we are referring to is the fact that once we have added the traps to G, we 
have destroyed the critical feature of the graph G, which is that the weights decrease exponentially 
(recall the observation we made above and the discussion at the end of Subsection 12. 3p . Hence, 
it is no longer true that once we find a discrepancy in some partition Vr, this discrepancy cannot 
be canceled by lower levels. In terms of analyzing Gowers' example, it might be the case that 
some pairs which were not 7-regular in G, might become 7-regular in H. Actually, there will be 
such pairs. This might completely ruin our ability to prove the H has only 7-regular partitions of 
Tower-size. 

We overcome the above problem by proving that it cannot happen very often. Namely, since 
the trap we have added originates from a random graph, then at least on average we expect it to 
contribute the same density to all pairs of vertex sets. So on average, we do not expect a trap 
to cancel a discrepancy caused by partitions that are refined by it. This is of course only true on 
average. To turn this into a deterministic statement, we formulate a condition that holds in random 
graphs, and show that if too many pairs that were supposed to be not 7-regular somehow turn out 
to be 7-regular, then we get a violation of the property we assume the trap to satisfy. Turning 
this intuition into formality is probably the most challenging part of this paper. One of the main 
reasons is that we cannot run this argument over all the pairs; instead we need to somehow "pack" 
them together and then argue about each of these packaged pairs. See Lemmas 16.41 and 16.51 

We now turn to the key lemmas of the paper. To state them we will need to define the notion 
of P -refinement. We briefly mention that this notion is crucial in overcoming another assumption 
we have used in the above discussion, that one is trying to construct an (e, /)-regular partition by 
using only the canonical partitions Vr- Using the notion of /3-refinement we will show that one 
actually has to approximately use only such partitions. 

Let < /3 < 1/2. Given two sets Z and X, we write Z dp X, to denote the fact that 
|Z n X| > (1 — /3)|Z|. We will sometimes also say that X /3-contains Z or that Z is /3-contained in 
X to refer to the fact that Z dp X. Note that since we assume that /3 < 1/2, there can be at most 
one set X which /3-contains a set Z. Given two partitions V = {Xi, . . . , Xm\ and Z = {Zi, . . . , Zk} 
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of V{H) and < /3 < 1/2, we shall say that ^ is a /3-refinement of V if for at least (1 — /3)k values 
of t, there exists i such that Zt dp Xi. Observe that if /3 = 0, then /3-refineinent coincides with the 
standard notion of one partition refining another one, that we discussed earlier. 

In what follows, when we refer to the graph H we mean the graph H defined in the previous 
section. We now state the two key lemmas we will prove later on in the paper. Getting back to the 
intuitive discussion above, one can think of the first lemma as formalizing condition (1) mentioned 
above, which we wanted H to satisfy. 

Lemma 3.1. Let f{x) = 1/x. Suppose A and B form an (e, f)-regular partition of H . If \A\ = 
k > 1/e then B is an e^'^ -refinement o/ 7^2 log log fc • 

Note that if /3 < 1/2 and partition ^ is a /3-refinement of Vr then the order of A is at least 
half the order of Vr- Hence the above lemma (implicitly) says that partition B, which must be 
l/A;-regular, must have order at least half times the order of P2iogiogfe- Recalling (l5|), this means 
that \B\ > (l/2)-T'^{2 log log k). We note however, that knowing that B must have Tower size is not 
enough for our proof to work. We actually need to know that ^B is a good refinement of partition 
^2 log log fe- This is needed in order to show that if a trap was placed between A and B then they 
will indeed fail to satisfy the second property of Definition 11.11 This is exactly where the notion of 
/3-refinement becomes useful, as we state in the second key lemma, which formalizes property (2) 
mentioned above that we wanted H to satisfy. 

Lemma 3.2. Suppose A, B are two partitions of H with the following properties 

• B is a refinement of A. 

• \A\ = k and H has a trap on a canonical partition Vh whose order is at least k'^. 

• B is an e^'^ -refinement ofVh- 

Then A and B do not satisfy the second condition of Definition ] 1.1\ In particular they do not form 
an [e., f) -regular partition of H. 

We end this section with the derivation of Theorem [3] from Lemma 13.11 and Lemma 13. 2[ 

Proof of Theorem [3} Suppose A and B form an (e, /)-regular partition of H, where |^| = k > 
1/e. Let rus denote the order of Vg, which is the largest partition on which we have placed a trap. 
Recall that s = w{jgy^log{l/e)) and that rus > s (in fact, rug = T'^(s)). Hence, by Claim [27il 



we have rUg > W{-^-s/log{l/e)). Therefore, if A; > y^mj we are done since J W {-^ ^/log{l / e)) > 
W{^ iyiog(l/e)) (with a lot of room to spare). 

We can thus assume that |^| = k < y/rug, and choose b to be the smallest index of a partition 
Vh, on which we have placed a trap satisfying \'Ph\ > k"^ ■ If we could show that B forms an e^'^- 
refinement of "Pfe, then an application of Lemma 13.21 would give that A and B do not form an 
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(e, /)-regular partition of H, which would be a contradiction. Now, Lemma |3. II tehs us that B is 
an e^/^-refinement of 7^2 log log fc- Note that if B is an e^' ^-refinement on 'P2iogiogfc then it is also an 
e^' ^-refinement of any partition that is refined by 'P2iogiogfc- In other words, it is enouglo that we 
show that h < 2 log log (A;). 

Suppose first that b = w{l), that is, the first trap of size at least /c^ is the first trap placed in 
H. Then recalling ([3]) and the fact that k > 1/e, we have 

b = w{l) = Lloglog(l/e)J < 21oglog(/c) , 

as needed. Suppose now that b = w{g+l) for some g > 1 and that the trap with largest order smaller 
than k^ was placed on V^' where b' = w{g). Then recalling ([!]) we see that b = [loglog(T'^(6'))J . 
We also recaU ^ stating that \Vb'\ = T't>{b'). We thus infer that 

T't'{b') = \Vy\ <k'^ , 

implying that 

b = [loglog(r'^(6'))J < loglog(A;^) < 21oglog(fe) , 

thus completing the proof. ■ 

As one can see from our proof of Theorem [3l what we show is not only that an (e, /)-regular 
partition must be large, but that the only way to get such a partition is to basically take A and 
B to be refinements of partition Vs in H. Recall that we started this section by saying that one 
should design H in a, way that will make sure that at least the proof of Theorem [2] will produce a 
large partition. The fact that the only way to get an (e, /)-regular partition is to take partition Vg, 
can be interpreted as saying that the only way to prove Theorem [2] is to go through the process 
described at the beginning of this section. 

4 Some Preliminary Lemmas 

In this section we prove some simple lemmas that will be used later on in the paper. But we start 
with proving the claims that were stated without proof in the previous sections. From this point 
on, when we write something like x <ra y, we mean that the fact that x < y follows from the 
facts stated in equation ([3]). As the reader will inevitably notice, we will be very loose in many 
of the proofs. The main reason is that as we are dealing with VK-type and Tower-type functions, 
many "improvements" make absolutely no difference even on the quantitative bounds one obtains. 
Hence, we opted for statements that are simpler to state and apply. 

Proof of Claim 12. 3t First, notice that for any m > 1, we can simply repeat the partition 
Ai = {l},Bi = {2}, a total of m times to get m partitions of the set {1, 2} such that there is no i 



^Recall that each partition Pr is a refinement of all the partitions Vr' with r' < r. 
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for which (distinct) j,j' appear in the same part. Since for 1 < m < 16, we have (j){m) = 2'"^'^^' = 2, 
the claim holds for these values of m. 

Suppose now that m > 17, set M = (j){m) = 2r™'/i61 g^,^^ consider a randomly generated sequence 
{Ai,Bi)^i of partitions of [M] obtained as follows; for each 1 < i < m and each 1 < j < M we 
assign element j to Ai with probability 1/2 (all mM choices being independent). Fix a pair of 
distinct elements j,j' G [M]. Clearly the number of i such that j,j' belong to the same class in 
(Ai, Bi) is distributed as the binomial random variable B{m, 1/2). Hence, we get from a standard 
application of Chernoff 's inequality that the probability that the number of these i is larger than 
3m/4 is bounded by e"™"'^. Hence, the probability that some pair of distinct j,j' G [M] belong to 
the same part in more than 3m/ 4 of the partitions is bounded by ( 2 ) e"™"' ^ < 1 so the required 
sequence of partitions exists. ■ 

Proof of Claim 12. 4t Let us start by proving that 

r<^(x)>r(L:r/2j), (6) 

as we have previously claimed. We first notice that when x > 256 we have 2^'^^ > 16x, implying 
that in this case we have 

</.(0(t)) > 22*/'Vi6 > 2* . (7) 

Now, one can verify that ([6]) holds when 1 < x < 10 and that T{x) > 256 when re > 4. Thus, when 
X > 11, we have 

tHx) > HHT^x - 2))) >|g HHn[x/2\ - 1))) >^ 2^(Lx/2j-i) ^ ^(Lx/2J) . 

We now recall ([3]) which implies that since we can assume that e is small enough, we can also 
assume that w{l) is large enough. In particular we have w{l) ^ W^(l) = T(l) = 2. Let us denote 
T{t) = [loglog(T'^(i))J. So w{i) is just T iterated i times with w{l) = [loglog(l/e)J. Now we shall 
show that for any large enough t, T{T{t)) > T{t). Using induction, it would follow that for all 
i > 1, w{i) > W{[i/2\), thus completing the proof. Now 

f(r(t)) = Liogiog(r'^(Liogiog(T<^(t))j))j 

> ^loglog('TQloglog(r(t/4)) 

> ^T(ir(t/4 

> '-rh-Tfi 

> nt), 
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where in the first inequahty we apply ([6]), in the second we use the fact that log log(T(x)) = T(x— 2), 
and the last holds for all large enough t. ■ 

We now turn to the proof of Claim [X71 Recall that given two sets of vertices R,R', which are 
not necessarily disjoint, we used e{R,R') to denote the number of edges connecting a vertex in R 
to a vertex in R', where an edge belonging to RD R' is counted twice. 

Claim 4.1. There is a constant C , such that if m = rrnj > C and O is a random graph from 
G{m, 1/2), then with probability at least 3/4 it satisfies the first condition of a trap (as stated in 
Definition \K 



Proof: Fix two sets R, R' of size r = \^/m/A\ . Given distinct i, i' let Zi^e' be the indicator for the 
event that (^,/) G E{0), and zr^w = J2eeRi'€R' ^^/'' Then, 

^ < y - ^["^'«'] = ^['^^' ^')] = 2 ('^^ - 1^ ^ ^'D ^ y ' 

for all large enough m. Now observe that zr^ri is a sum of at least (Q indicators Z££i and each Z£^£i 
can change the value of zr^r^ by at most 2. We thus get from a standard application of Chernoff 's 
inequality that 



e{R,R')--r' 



> -r 



< 



\zR,R' -K[zR^R>]\ > -r' 



< e 100 . 



Hence the probability that there is any pair of sets R, R! satisfying \e{R, R') — ir^| > ^r^ is at most 



\ 2 

2-WJ'-'' < m^e-"'/^^°^ < 1/4 



for all large enough m. 



Claim 4.2. There is a constant C , such that if m = nn, > C and O is a random graph from 
G{m, 1/2), then with probability at least 3/4, it satisfies the second condition of a trap (as stated 
in Definition [27l 



Proof: Let us start by considering the case b' = b — 1. Suppose Ui, . . . , Umh_-^ is the partition 
of V{0) induced by the partition Vt^i (as discussed prior to Definition 12. 6p . Now recall (see 
Subsection 12. 2p that the integers mt satisfy the relation 

log(7Ti) < mb_i < 171og(7n) , (8) 



This means that 
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so the size of the sets Ui, which we wih denote by /ib_i, satisfies 

m/17log{m) < hh~i = m/rrnj^i < m/log{m) . 



(9) 



Fix now two sets Ui,Uj, an integer 200 < k < log(m,), a subset i? C [7j of size k^ and a subset 
R' C Uj of size [/ib_i/A;]. Given distinct i,i' with i £ R and i' £ R' let Z£^i/ be the indicator for 
the event that {£,£') G E{0), and z/jr/ = X]^eK£'e-R' -^^Z'' Then 



|i?l|i?'l 



>E[z/j,^,]=E[e(i?,i?')] 



(|i?||i?'|-|^ni?'|) 



> -I-RII-R'I 



\\R\ 



> 



l-i?)™"'^- 



where in the last inequality we use the facts that k < log(m), that \R'\ = Ihb-i/k] >|m m/17k log(m) > 
m/171og (m) and that we can pick m to be large enough so that \R'\ > k^. 

Note that 2;_r,_r' is a sum of at least |i?|(|i?'| — \R\) > |i?||i?'|/2 indicators zg// (we are using the 
fact that \R\ <^ \R'\)- Since each of them can change z_r,_r' by at most 2, we get from Chernoff's 
inequality, the fact that k > 200, and the estimate for E[2;^ /j/] from the previous paragraph that 



e{R,R')--\R\\R'\ 



>T9l^ll^'l 



< 



< 



< 



< 



\zb,r' -K[zR^ji, 



£ ^mi^i 



I-RII-r' 



'A:/ii,_i/64 



-2/1. 



Now, there are rn'^_^ = 0(log (m)) ways to pick the sets Ui,Uj, 0(log(m)) ways to choose k, 
( k^^) ^^y^ t° Pi^^ ^ ^^'^ {h ''~)k) '^^ys to pick R'. Overall, we get from a union bound that the 
probability that some choice of Ui, Uj, k, R and R' will violate the second condition of Definition 
is bounded by 



O(log^m) 



h-i 
k^ 



hb-i 
hb-i/k 



-2h,_, <^2fc«(g^) 



hb-i/k^-2hi,-i ^ ^j^ 



21og''(m)g-/i6_i 



(10) 



where in the first inequality we use the inequality (^) < (en/k) and in the second the fact that 
k < log(?7i). 

Let us now consider an arbitrary b' < b. Note that since mf,/ < rrib-i, we still have my < 
171og(?Ti-). Hence there are still only 0(log {m)) many ways to choose the sets U^ ,U^ . This 



means that the upper bound obtained in (|10p for the probability of partition Vb-i violating the 
condition applies to any given partition Vy, with hb~i replaced by hb'. But since hy > hb-i the 
right hand side of the bound in pO|) still holds. 
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We finally recall (P stating that mb = T't'ih). As we noted in ^ we have T'f'{h) > T{[b/2\). 
Hence the number oi b' < b we need to consider is only 0(log*(m)). So combining this fact with 
the discussion in the previous paragraph we get that the probability of any partition Vj,' violating 
the second condition of Definition 12.61 is bounded by 

where we apply the fact that hb-i > m,/171og(m), stated in ([9]). ■ 

Proof of Claim 12. 7t Follows immediately from Claims 14.11 and 14.21 ■ 



We will now prove two lemmas which will somewhat streamline the application of the properties 
of traps later on in the paper. Both lemmas will rely on the observation stated in Lemma [4.3l below. 
In what follows, we use vs € M", with S C [n] to denote the vector whose i entry is 1/\S\ when 
i £ S and otherwise. Let Vk = {vs : S '^ [n],\S\ = k}. 

Lemma 4.3. If x £ [0, l/k]"" and ^Xi = 1, then x is a convex combination of the vectors ofVk- 

Before we prove this lemma, we need a standard theorem from linear programming theory, 
which we state without proof. A polyhedron P C R" is the set of points satisfying a finite number 
of linear inequalities. P is bounded if there is a constant C such that ||x|| < C for all x £ P. Finally, 
a point X G P is said to be a vertex of P if it cannot be represented as a proper convex combination 
of two distinct points x',x" G P. 

Theorem 4 ([6j). For every bounded polyhedron P C M" and x G P, the point x can be written as 
a convex combination of the vertices of P. 

Proof of Lemma 14. 3t Consider the polyhedron 

P = <x : y^Xi = 1, and < xi, . . . ,x„ < 1/k > . 

Notice that for all x G P, we have ||x|| < 1. Let V be the set of vertices of P. By Theorem [H we 
have that any x E P is a convex combination of V. So we need to show thalo V C V^. 

Suppose u G V. If all its entries are either or 1/k it obviously belongs to Vk- So suppose 
that u has an entry Ui G (0, 1/k). Then there exists at least one more entry Uj £ (0, 1/k), because 
otherwise the entries cannot sum to 1. Let Eu = 2 i^i'^l^ji'^ii 1/^ ~ Ui,l/k — Uj}. Let ej denote 
the canonical basis vector where the ith entry is 1 and all the other entries are 0. Similarly define 
Cj. Let u' = u-\- Eu^i — Eu^j and u" = u — E^ei + E^ej. It can be checked that both u', u" G P and 
that u' + u" = 2u. So u can be written as the convex combination of two other vectors in P, which 
means that u is not a vertex of P. ■ 



'We clearly have Vfe C V but this direction is not needed. 
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We now turn to prove two lemmas. The first one will help us in applying the first property of 
traps in proving Lemma 13.21 while the second one will help us in applying the second property of 
traps in proving Lemma |3.1[ 

Lemma 4.4. Suppose O is the graph that was used when defining the trap on partition Vh (so 
1^(0)1 = mi) and we can assume that O satisfies the first condition of Definition \2.6\) . Let Q be 
the adjacency matrix of O, and suppose x,y £ [0,1]™''' satisfy '^Xi = ^yi = g > i/m^/2. Then 
we have 



x^Qy - 2^^ 



1 2 



Proof: The vectors x/g and y/g satisfy the condition of Lemma 14.31 with k = \^Jrrib/A\ . Hence we 
can express x/g and y/g as convex combinations of the vectors of Vk as x/g = J2r o-R^r and y/g = 
'}2r'^R''^R' ■ Observe further that {vr)'^Qvri = e{R,B!)/\R\\R'\. Since \R\ = \R!\ = k = \^/rnh/4] 
and we assume that O satisfies the first condition of being a trap, we can infer that for any R and 
R' we have 

1/4 < {vRfQvR, < 3/4 . (11) 

We can thus infer from (jlip and the fact that '^j^aRVR and Y2r' ^R'^R' are convex combinations 
that 



{x/gfQ{y/g) 



I ^ aRVR I Q I ^ bRiVRi I 
y^ aRbR'{vR)^QvRi 



< 



R,R' 
R,R' 



3 

4 ' 

implying that x Qy < jg^. An identical argument gives x Qy > jg'^, which completes the proof. 



Lemma 4.5. Suppose O is the graph that was used when defining the trap placed on partition Vb 
(so 1^(0)1 = ru}, and we can assume that O satisfies the second condition of Definition \2.6\) . Let 
Q be the adjacency matrix of O. Let h' < b, set m = my and let Xi, . . . ,Xm be the partition of 
V{0) mditceco by Vy ■ Suppose each of the sets Xi has size h and let Xi,Xj be two of these sets. 
Suppose 6 and x,y £ [0, 1]™'' satisfy the following conditions: 



^"^This was defined explicitly just before Definition [2]6] Since we are identifying the clusters of Vb with the vertices 
of O we can also identify these clusters with the indices of the adjacency matrix Q. Hence, since we think of Xi as a 
subset of vertices of O, we can say (as we will in item 2) that an index of a vector x £ [0, l]™' belongs to Xi. 



18 



1. l/log(m6) <5 < 1/200. 

2. The vector x has non-zero entries only in Xi and y has non-zero entries only in Xj. 

3. For each I <p' < m^ we have Xp//{J2 Xp) < 6^. 

4- TJ:iiyv>'^5h. 



Then, setting gi = ^ Xp and g2 = Yip Vpj '^^ have 



X Qy- -5152 



< 2^2^152 . 



(12) 



Proof: Put k = [1/S\. Then item (1) of the lemma guarantees that 200 < k < log{nHy). Item (3) of 
the lemma guarantees that the vector x/gi satisfies the condition of Lemma [4. 31 with respect to k^. 
Hence we can write x/gi = YIr ^bVR using the vectors of V^e. Moreover, since item (2) guarantees 
that X has non-zero entries only in Xi we know that in the convex combination YIr o-R^R all the 
sets R satisfy R (^ Xi. Observe now that item (2) guarantees that y has non-zero entries only in 
Xj . Item (4) of the lemma guarantees that the vector y/g2 satisfies the condition of Lemma 14.31 
with respect to [/i/A;] . Hence we can write y/g2 = Yb' ^R''^R' using the vectors of V\^h/k'\- Again, 
we know that in this convex combination we are only using sets R' C Xj. 

Now, {vrYQvri = e{R,R')/\R\\R!\. Hence, if \R\ = k^ and \R!\ = \h/k'\ and R C Xi, Rl C Xj, 
then we can use the assumption that O satisfies the second condition of being a trap, to conclude 
that 



{vr) Qvr' - - 



< 1/k^ < 26^ . 



(13) 



We can thus infer from (J13p and the facts that Yr^R'^^R ^ud Yr' ^R'^r' are convex combinations 
that 



ix/gifQ{y/g2) = (^aRVRJ Q (^.b 

= '^aRbRf{vR)^QvR' 
R,R' 

< (1/2 + 25^) Y,aBbR> 



R'VR' 



R,Rf 



(1/2 + 25"^ 



implying that x^Qy < {l/2 + 2S'^)gig2. An identical argument gives x^Qy > {l/2 — 2d'^)gig2, which 
completes the proof. ■ 
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5 Proof of Lemma 13.21 

Suppose A = {Vi:l<i<k} andB = {Ui^i, : I < i < k,l < i' < i] {so \B\ = M). We will say that 
a pair of sets {Vi, Vj) is had if there are two sets Ci, C2 ^ [i] x [£], each of size at least e£^ such that 
|d(C/i,ii,f7jjJ - d{Ui^i2,Ujj2)\ > 2e for every (hji) £ Ci and {12, J2) e C2. Note that if {Vi,Vj) 
is bad then it cannot be good in the sense of Definition 11.11 Hence, to show that A and B fail to 
satisfy the second condition of Definition 11.11 it is enough to show that there are at least €(2) bad 
pairs {Vi,Vj). As we mentioned after the statement of Theorem [3l we will actually show that there 
at least (1 - 2e^^'^^){l) bad pairs. 

A set Ui^i' is called useful if there is an X € Vb such that Ui^i' C^i/5 X. If C/j^j/ is not useful, we 
call it useless. A set Vi is called useful if it containa^l less than e^'^^i useless sets Ui^i/. If Vi is not 
useful, we call it useless. Observe that there can be at most e^'^'^k useless sets Vi, as otherwise B 
would not be an e^' ^-refinement of Vb, which would contradict the third assumption of the lemma. 
Hence, there are at least (1 — 2e^/^'^)(2) pairs of useful sets {Vi, Vj). By the previous paragraph, it 
is enough to show that every such pair is bad. 

So for the rest of the proof, let us fix a pair of useful sets {Vi,Vj). Let us assume that e is small 
enough so that e^'^ < 1/2. Given a useful set C/j^j' C^i/s X G Vb, we let X'p^{Ui^i') denote this 
(unique) cluster in Vb that e^' ^-contains C/j,j'. We will later prove the following claim: 

Claim 5.1. // Vi and Vj are both useful, then there are Di,D2 ^ [i] x [i] satisfying the following: 

• Di and D2 have size at least ^i'^ ■ 

• For every {ii,ji) € Di both Ui^i^ and Ujj-^ are useful and the pair {X'p^^{Ui^i^),X'p^^{Uj^j^)) 
belongs to the trap placed on Vb- 

• For every {12, J2) ^ -^2 both Ui^i^ and Ujj^ o,f^ useful and the pair {X'p^{Ui^i^), X'p^{Ujj.^)) 
does not belong to the trap placed on Vb- 

In the next subsection we prove the lemma assuming Claim [STTl in the subsection following it 
we will prove this claim. 

5.1 Proof of Lemma 13.21 via Claim 15.11 

Let a be the weight added to H by the trap that was placed on Vb- Let Di,D2 be the subsets 
of [(] X [I] guaranteed by Claim [5TT1 Take any pair {ii,ji) G Di and let Xi = X-p^([/j^jj) and 
X2 = X-p^{Ujj-^). Since {ii,ji) G Di we know that the pair (Xi,X2) was assigned an extra weight 
of a by the trap placed on Vb- Now consider the traps with weight larger than a, that is, the traps 
that were placed on partitions V which are refined by Vb- Note that (Xi,X2) might get an extra 



"" Recall that each Vi is the union of £ sets [/,; : 
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weight from a subset of these trapq^. But since H contains only ^Y^log(l/e) many traps, the 
number of ways to choose the subset of the traps with weight larger than a from which [Xi , X2 ) 
get an extra weight is bounded by 248 V °s( /«) ^ 1 ^ Hence Di must have a subset of pairs of size 
at least e£^, denoted D'^, and set of weights Wi (all larger than a) with the following property; if 
a' > a and V' is the partition on which the trap with weight a' was placed then for any (ii ,ji) G D[ 
the pair {X-pi (JJi^i^) , X-pi {U j^j^)) belongs to the trap on V' if and only if a' G Wi. We can also define 
D2 and W2 in the same manner. 

We now claim that we can take Ci and C2 (the sets showing that {Vi,Vj) is bad) to be the sets 
D'l and 1)2 • First, as noted above, both D'^ and D2 have size at least e^^. So to finish the proof we 
will have to show that for every (ii,ji) G D'^ and {12, J2) S D2 we have 

\d{Ui,i„Ujj,) - d{Ui,i,,Ujj,)\ > 2e . (14) 

Let a' be the largest weight that belongs to exactly one of the sets Wi and VF2. Assume without 
loss of generality that a' G Wi and a' VF2. If there is no such weight (that is, Wi = W2) then 
set a' = a. We now recall Fact 12.81 which tells us that 



a' > 4-45Vi°g(iA) . (15) 

Let V' be the partition on which the trap with weight a' was placed. Since traps with weight at 
least a are placed on partitions that are refined by Vb, we see that if a set C/j^j' is useful with respect 
to Vb it must also be useful with respect to V . This means that for each pair (^i, ji) G D[ the trap 
at T" increases d{Ui^i^,Ujj^) by at least 

a (1 - e^'^)^ > a {I - 2e^'^) > 0.99q' . 



Similarly, for each pair {12-, 32) S ^2 ^^^ ^^^P ^^ ^' increases d{Ui/i^, ^jd^) by at most 

2a'e^/^ < O.Ola' . 

Hence, disregarding for a moment all the other weights that can be assigned to these sets in H^ we 
see that all the pairs in (ii,ji) G D'^ are such that d{Ui^i-^,Ujj^) > 0.99a' while all {12, J2) £ D2 are 
such that d{Ui^i2, Uj^j^) < O.Ola'. We will now show that this discrepancy is (essentially) maintained 
even when considering the entire graph H. 

First, recall that by Fact 12.51 the total weight assigned to any pair of vertices of H in the graph 
G is bounded by l/4v ^°s(i/'=). Hence, recalling (fTSj) . we see that even after taking into account these 
weights, we have d(Ui^i^,Ujj^) < 0.02a' for any {12, J2) £ D'2. Let us now consider the contribution 
of the weights coming from traps that were assigned a weight smaller than a'. Since these weights 



^*More precisely, if Xi and X2 are subsets of the same cluster X' £ V' , then they will never get an extra weight 
from the trap placed on V' . If they belong to different clusters X[,X2 G V , then they will receive an extra weight 
only if {X[,X2) belong to the trap placed on V' ■ 
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are a'/^' a' /16, ... their sum is bounded by a'/3, so after taking these weights into account we still 
have d{Ui^i2,Ujj^) < 0.36a' for any [12, J2) G -Dg. Let us now consider the contribution coming 
from traps with weight more than a' . Consider any trap with weight a" > a' that was placed on a 
partition V" . Recall that by definition of Wi, W2 and by our choice of a', either the extra weight 
a" was added to all pairs {X-pn {Ui^ij) , X-pn {U j^i)) with {i' ,j') € D[ U D2 or to none of them. Since 
all the sets C/j^j^ and Ujj-^ are useful we see that for each pair {ii,ji) € D[ the pair {Ui^i-^, Ujj-^) gets 
from the trap at V" a total weight at least 

(l-ei/5)'>a"(l- 26^/5). 



// 
a 



Set w to be the sum of the weights in Wi that are larger than a' . Then the above discussion implies 
that for each (?i, ji) G D[ we have 

d{Ui^i,,Ujj^) > (l-2e^/^)w + 0.99a' > t;; + 0.99a' - 2e^/^ . (16) 

Consider now a pair {12, J2) £ D'2, If a weight a" > a' belongs to W2 then it can contribute to 
d{Ui^i^, UjjA a weight of at most a", hence such weights contribute to d{Ui^i2, ^jji) ^ total weight 
of at moslo w- As to weights a" > a' that do not belong to W2, we see that since Ui^i^ and Ujj^ 
are useful, they can increase d{Ui^i.^, Ujj^) by at most 2a"e^'^. As the total sum of weights of all 
traps is at most 1, this extra contribution is bounded by 2e^'^. All together, we see that for every 

{i2,J2) ^D'2, 

d{Ut,t2,Uj^j^) <w + 0.36a' + 2e^/^ (17) 

Recalhng ([15]), we see that 4e^/^ < 0.1a'. Hence, ([16]) and ([I?]) imply that 

d{Ui,h,Ujj^) - d{Ui^i^,Ujj^) > 0.5a' >|Y5j 2e 

for every choice of (ii, ji) G D[ and (12, J2) G D2. This establishes ([T^ . thus completing the proof. 

5.2 Proof of Claim l5A] 

Let us start with observing that since Vi is assumed to be useful, it contains (more than) ^i useful 
sets Ui^i/. Let V^ be the union of ^^ such sets, and define K' is a similar way. From now on we will 
focus on V- and K' and their subsets C/j.j' and l/jji so we will only be talking about sets C/j^j' and 
Ujj' that are useful. Recall that for any useful set Ui^i' there is a (unique) set X'p^{Ui^i') G Vh such 
that Ui^i> C,i/5 X'p^{Ui^i>). 

Suppose Vb has m clusters and recall that we defined the trap on Vb using an ?7i-vertex graph O 
satisfying the first condition of Definition 12. 6[ That is {u, v) is an edge of O if and only if [Xu,X^) 
belongs to the trap on Vb- Define a vector x G [0, 1]™" by setting Xu = |VJ' n Xu|/|Xu|. Define 
y G [0, 1]'" similarly by setting y^ = |K' n Xu|/|Xtj|. Recall that each of the sets Vi contains a 



'Recall that by choice of a' the sets Wi and W2 contain the same weights larger than a' . 
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1/fc-fraction of the vertices H (since |^| = k) so \V-\ contains a l/2/i;-fraction of the vertices of H. 
Since Vb has order m (so there are m sets X^) and we assume that m > k"^ (in the second item of 
Lemma I3.2P we infer that 

Y,Xu = Y,yu = ^>V^/2. (18) 

u u 

If we take Q to be the adjacency matrix of O, then by (jlSp we can apply Lemma r4.4l (with g = m/2k) 

to infer that 

1 3 

-{m/2kf < x^Qy < -{m/2kf . (19) 

Given a set C/j^j/ we define a vector x* by setting x\^ = \Ui^i' n Xu|/|Xtt|. Similarly given a set Ujji 
we define a vector y^ by setting yi = \Ujj' n Xu|/|Xm|. Observe that since V^ is the union of the 
sets Ui^i' we have x = ^^, x* where the sum ranges over all the i/2 indices i' for which C/j_j' C V- . 
Similarly y = ^j/ y-' where the sum ranges over all the i/2 indices f for which Ujj' Q V'. Hence, 
we get from (J19p that 

\{m/2kf < Y^i^'fQv'' < \{^/2kf . (20) 

Consider now any pair i\j' in the above sum. Let X^' = Xp^{Ui^i/) and X^i = Xp^{Ujj/). 
Recall that C/j^j' contains a 1/ki fraction of V{H) while the sets X^ contains a 1/m fraction of 
V{H). This means that 

J^ x^ = m/ke , 

u 

and similarly we have 

Y^ y( = m/ki . 

u 

Hence 

< (x^yg/ < m?/k'^l'^ . (21) 

More importantly, since |C/j^j' n X^/j > (l — e-^'^) |C/j^j'| we have 

xJ;, = |C/iy r\Xu'\/\Xu'\>{l- e^/^) m/ki , (22) 

and since |f/jj' n X^'| > (l — e^'^) |C/jj'| we have 

2/^; = \Ujj> r\X,,\/\X,.\>(l- e^/^) m/A:£ . (23) 

Suppose now that {Xu>-,Xyi) belong to the trap placed on Vb, that is, that Qu>,v' = 1- We then 
get from (HU, ([22]) and ([23]) that 

Q.mm'/ee < (l - ei/5)' mVA:'^' < {x^'fQy^' < m^kH^ . (24) 

Suppose now that {Xu',Xy') does not belong to the trap placed on Vb, that is, that Qu',v' = 0. We 
then get from ^, ^ and ^ that 

< {x''fQy^' < 2e^/^m^/k^f < OMm^/k'^f . (25) 
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We thus see from (j25p that the total to contribution to (j20p of pairs {i',j') for which {Xu',Xyi) 
does not belong to the trap is bounded by (^/2)^ • O.Olm^ /k'^P = 0.0l{m/2k)'^ . Combining ([20]) . 
([MD and ^5^ it thus must be the case that there are at least 

l{m/2kf - 0m{m/2kf 1 ^ 
m2/fc2£2 - ^^ ' 

pairs {i' ,j') for which (X^', X^/) belongs to the trap placed on Vb- Hence we can take Di to be the 
collection of these pairs. Finally, we see from (I20p . (I24p and (I25p that the number of pairs {i' ,j') 
for which (X^/jX^') belongs to the trap on Vb cannot be larger than 

|(m/2/c)2 ^31,2 



0.99m2/A:2£2 - 32 ' 

so we can take D2 to be the collection of pairs {i' ,j') that do not belong to Di. We thus complete 
the proof of Claim 15.11 

6 Proof of Lemma 13.11 

We will prove Lemma 13.11 by first performing a series of reductions that will culminate in Lemma 
16.51 We will then spend most of this section proving Lemma 16.51 Let us first derive Lemma 13.11 
from the following lemma: 

Lemma 6.1. Suppose 7 < e and Z = {Zi, . . . , Z^} is a ^-regular partition of H . Assume 

, ^< l°g(l/7) 

10Vlog(l/e) 

• 7^/^ < /3 < 1/100 

Then, if Z is a j3 -refinement ofVr-i it is also an ^(3 -refinement ofVr- 

Proof that Lemma 16. II implies Lemma l3.H By the definition of (e, /)-regularity, we get that 
if 1^1 = k then B must be ^-regular. Since k > 1/e we have 1/k < e. Since i3 is a refinement of 
Vq (recall that Vq is just the entire vertex set of H), it is in particular a (l/A;)^'^-refinement of Vq. 
Hence, starting with /3 = (l/k)^''^ we can repeatedly apply Lemma \6A] (with 7 = 1/k) as long as 



\/logTk) log k , , 

r < ^ ^^ ' < ^ (26) 

- 10 - lO^biOM 

and 

87A;i/^ < 1/100 . (27) 
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Taking r = 21oglog(/c), we thus make sure that both ()26p and ()27p hold^i with a lot of room to 
spare. Hence, after these r = 2 log log k applications of Lemma 16.11 we get that B must be an 
82i°si°sV^^/^-refinement of Psiogiogfc- Since 

we get that B is indeed an e^' ^-refinement of 'P2iogiogfc- ^ 

Let us now continue with the proof of Lemma 16.11 So throughout the rest of this section we 
assume all the conditions that are stated in the lemma. Suppose Vr-i = {^i : 1 < i < in} and 
Vr = {^iy : 1 < i < m,l < i' < M}. Recall the sets Aij,Bij that were used in the construction 
of the graph G in Subsection 12.21 With respect to these, we make the following definition: 

Definition 6.2. A pair of sets {Zt,Zu) is said to be /3-helpful if 

1. There arrH I < i,j < rn such that Zf dp Xi and Z^ dp Xj (we are not requiring i ^ j). 

2. We have mm{\ ZtnAij\,\ZtnBij\) > ^'^\Zt\. 

We will need the following lemma, restated from ^. 

Lemma 6.3. ([9]) Let M be an integer and let (Aj, Bj)'JLi be a sequence of balanced partitions of 
[M]. LetO<(< 1/2 and let r/,^ > be such that 

(l-r/)(l-40>l-C + C'. (28) 

Then for every sequence A = (Ai, . . . , Am) such that Xi' > for every i' , ||A||i = 1 and \\X\\oo < 1 — C; 
there are at least rjm values of j for which niin(^j,g^. \',J2i'eB ^i') ^ ^• 

Lemma 6.4. Suppose Z is a P -refinement ofVr-i- Then, if Zt Cp Xi for some i, but there is 
no i' for which Zt C8/3 ^i,i', then there are at least 2(5m sets Xj such that each of these sets Xj 
fi-contains at least i^ sets Zu such that {Zt,Zu) are j5-helpful. 

Proof: Let Zt Cp Xi and suppose that there is no 1 < i' < M for which Zt Cs/s ^i,i'. Write Aj/ for 
\Zt n Xi^i>\/\Zt\. Then A^/ > for all i' , ||A||i > 1 - /3 (since Zt Cp Xi) and ||A||oo < 1 - 8/3 (since 
we assume that there is no i' for which Zt C8/3 Xi^). Set C = 7/3/(1 — /3) < 1/2 and note that we 
have 

(1 - 6/3)(l - 8/3^) > 1 - 6/3 - 8/3^ > 1 - C + C^ (29) 

where in the second inequality we use the fact that /3 < 1/100. Define the vector A' = A/||A||i. 
Then ||A'||i = 1 and 

IIA'lloo < (1 - 8/3)/||A||i < (1 - 8/3)/(l - /3) = 1 - C . (30) 



^"Recall that k > 1/e. Since Theorem [3] allows us to assume that e is sufficiently small, we can assume that k is 
large enough so that 2 log log fc < ^'°q''°' and that 82i°gi°gfe/fci/4 < i/iqo. 

^^Note that since /? < 1/2 there is (at most) one choice of Xi and Xj such that Zt Cp Xi and Zu Cp Xj. 
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Since {A'- -,3'- j)^i are balanced partitions of [M], we can apply Lemma [6T3l to the vector A' 
(with r] = 6/3 and S, = 2/3^), and conclude that there are at least 6(3m values of j, for which 
™^^^i^i'GA' K'-'^i'eB' K') -^ ^/^^- Recalling that A' = A/||A||i and that ||A||i > 1 — /3 this means 

^iJ *ij 

that for each such j we have min(^-/p v Aj', ^j/pn' Aj/) > 2/3 (1 — /?) > /3 . Notice that by the 
construction of the sets Aij,Bij, (that is Aij = Uj/g^/ .Xj j/ and Bij = Uj/g^/ Xj^j/) and by the 
definition of A, these j's satisfy 



I, J ' ■■' ^ I, J 



min(|ZinA„-|,|ZinA,il) >rl^i| , (31) 

that is, they satisfy the second condition of being /3-helpful. This means that if a set Z^ is /3- 
contained in Xj then (Zt, Z^) is /3-helpful. So to finish the proof, we need to show that out of the 
6/3m values of j that satisfy (|3ip . at least 2/3m are such that Xj /3-contains at least k/2m sets Z^. 
Hence, it is enough to show that "Pr-i has at most 4/3?n, sets X that /3-contain less than k/2m sets 
Z £ Z. 

Call a vertex v G ViH) bad if it either belongs to a set Z G Z that is not /3-contained in 
any X G Vr-i or if it belongs to Z \ X where Z (Zp X. Note that since we assume that Z \s a. 
/3-refinement of Vr-i then the fraction of H''s vertices that are bad is bounded by 2/3. Suppose now 
that there are more than 4/3m, sets X that /3-contain less than k/2m sets Z. Recall that each set 
X contains a l/?n,- fraction of vertices of H, while each Z contains a l//c-fraction. Therefore, if X 
has less than k/2m sets Z that are /3-contained in it, then half of its vertices belong to sets Z that 
are either /3-contained in another set X' or that are not /3-contained in any set. Hence, ifVr-i has 
more than 4/3m such sets X, then more than 2/3-fraction of H^s vertices would be bad which is 
impossible. ■ 

The main part of the proof of Lemma |6. II will be the proof of the following lemma 

Lemma 6.5. Suppose Z G Z and Xi,Xj G "Pr-i- Suppose Z dp Xi and there are -^i^ sets Zu C/3 Xj 
such that {Z, Zu) is fi-helpful. Then at least ^ of the sets Z^ are such that (Z, Zu) is not ^-regular. 

We first derive Lemma l6.ll from Lemmas 16.41 and 16.51 

Proof of Lemma I6.lt By Lemma 16.41 we know that if Zt dp Xi for some z, but there is no i' 
for which Zt dsp Xi^ii, then there is St C [m\ of size at least 2(3m such that for any j G St, the set 
Xj /3-contains at least k/2m sets Z^ for which {Zt,Zu) is /3-helpful. By Lemma 16.51 each of these 
sets Xj /3-contains at least k/Am sets Zu such that {Zt,Zu) is not 7-regular. Hence, all together 
(that is, when considering all the sets Xj where j £ St) there are at least /3k/2 sets Zu such that 
(Zt, Zu) is not 7-regular. Hence, since /3^ > 7 and we assume that Z is 7-regular, there cannot be 
more than 2/3/c sets Zt as above. 

Since we assume that for at least (1 — (3)k of the sets Zt there is a set Xi such that Zt dp Xi, 
it follows that for at least (1 — 3/3)A; > (1 — 8f3)k of the sets Zt there exists an Xi and i' such that 
Zt dsp Xi^ii, which means that Z is an 8/3-refinement oiVr- H 

In the next subsections we complete the proof of Lemma 16.11 by proving Lemma 16.51 
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6.1 Setting the stage for the proof of Lemma 16.51 

We start by setting some notation and observing some relations between the parameters involved. 
We remind the reader again that we will be assuming the conditions of Lemma |6. 11 Also, hereafter 
we focus only on the k/2m sets Z^ dp Xj such that {Z,Zu) are /3-helpful, namely the sets in the 
statement of Lemma 16.51 

Let us set A = Z D Aij and B = Z D Bij. Also for each of the sets Z^ dp Xj, if |Z„ n Aj^i\ > 
\Zu n Bj^i\ we set Wu = ZuCi Aj^i, otherwise we set Wu = Z„ n Bj^i. Since we assume that all the 
pairs [Z, Zu) are /3-helpful and that /3 > 'y^'^ we can deduce that 

mm{\A\,\B\) > f\Z\ > j^/^\Z\ , (32) 

and for all u we have 

|Ty„|>(l-/3)|Z,|/2>|Z„|/4. (33) 

Let Vri, ■■■,Vrf be the canonical partitions which refine Vr-i and on which we have placed a 



trap. For each 1 < £ < /, let a^ be the weighto that was added to H when placing a trap on 
partition Vr^- Recall that H contains ^Y^log(l/e) many traps so 



1 



/<-yiog(l7e). (34) 



Also recall that by Fact 12.81 we have that all weights ai, . . . , a/ satisfy 



ai,...,Q/>4-^VMiA) . (35) 

Set 

A-r 

(36) 



4Viog(i/^) ' 

and recall that S is the extra weight we have added to some of the pairs (x, y) in G when considering 
partition Vr—i- Since in Theorem [3] we can assume that e is sufficiently small, we get from ()34p . 
(I35|) and ([Ml) that 

6 <^-,ai,...,af . (37) 

We also observe that since 7 < e, and Lemma 16.11 assumes that r < — °f^ '"'' we get from (I36p 

10Vlog{l/e) 

that 

7^/^ < S . (38) 

We now define a set A' d A using the following iterative process. We first set Aq = A. If each 
of the clusters X G Vn is such that |AonX| < (5^|j4o|, then the process ends with A' = Aq. If there 
is a cluster X £ Vr^ such that |Ao n X| > (5^|j4o| then we set ^1 = |Ao n X|, and continue to the 
next phase. If each of the clusters X G Vr2 is such that |^i n X| < (5^|Ai|, then the process ends 



So recalling the way we have defined H in Subsection 12.31 we get that ii re = b — uj{g) then a^ = 4 

27 



with A' = Ai. If there is a cluster X E Vr^ such that |Ai fl X| < (5^|^i| then we set ^2 = 1^2 n X| 
and move to the next phase. So the process either stops at some level Vn in which none of the 
clusters of Vr^. contains more than a (5^-fraction of At-i, or it goes all the way to Vr.- 

Let us make two important observations about A' . First, if the process stops at level Vrt (where 
t < f) then for any t' > t we have |^' n X| < (5^|^'| for all X e Vr^,- This follows from the fact 
that Vr I refines Vrt- Therefore, A' has the property, that for each partition Vrt ^^^ set A' is either 
contained in a single cluster X G Vrt o^' none of the clusters contains more than a 5^-fraction of A' . 

The second observation is that at each iteration the process picks a subset Ai satisfying |^i| > 
5^|Aj_i|. Since we have at most / iterations, we get that the final set A' we end up with satisfies 



where the third inequality relies on the assumption of Lemma 16.11 that r < — °f^ ''^' and the last 

10-y/log{l/e) 

uses ([32]) and the fact that 7 < e. We now use the same process to pick a set B' O B satisfying the 
same properties discussed above, and whose size also satisfies 

\B'\>-f\Z\. (40) 

Take one of the sets W = Wu and assume without loss of generality that W C Aj^i. Recall that 
by dciA'jW) and dG{B',W) we denote the densities between these sets in the graph G, that is, 
before adding the traps to obtain the final graph H. First note that since A',B' both belong to 
Xi G Vr-i and W (^ Xj, we can infer that exactly the same weight was added in G to d{A' , W) and 
d{B',W) by the partitions V that are refined by Vr-i- Now recall that we put weight 5 between 
all the edges connecting a vertex in Aij and a vertex in Aj^i and that we did not do so for edges 
connecting a vertex in Bij and a vertex in Aj^i. Since A' C Aij, B' C Bij and W C Aj^i this 
means that Vr-i creates a discrepancy of 5 between dG{A',W) and dQ{B' ,W). Now recall that 
the weights assigned by G to the partitions V which refine Vr-i are 6/4, 6/4?, 6/4:^, . . .. Since the 
sum of these weights is at most 6/3 we get that 

\dG{A',W)-dGiB',W)\ > ^5 >|38l 7 • (41) 



It thus follows from (j33j) (|39|) . (jlOj) and (pT|) that if we had not added the traps to G, we would 
have thus concluded that every /3-helpful pair {Z,Zu) is not 7-regular. So to finish the proof we 
need to show that a large number of these /3-helpful pairs are not 7-regular in H as well. 

Recall that Vn , ■■■, Vrt are the partitions which refine "Pr-i and on which we have placed a trap. 
For 1 < £ < / we let d^{A, B) be the weight added to d[A, B) by the trap placed on Vr^ We thus 
have the following claim: 

Claim 6.6. // {Z, Z„) is ^-regular, then there is 1 < i < f for which 

\de{A', Wu) - de{B', Wu)\ > 46^ . (42) 
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Proof: Recall that since both A',B' C Xi £ P,._i and Wu C Xj G T^^.i we get that dH{A',Wu) 
and dniB' , Wu) get the same weight from each of the traps placed on partitions Vr' that are refined 
by Vr-i (that includes the case that a trap was placed on Vr~i)- This means that a discrepancy 
between dniA' ,Wu) and dH{B',Wu) can come either from ddA' ,Wu) and dciB' ,Wu) or from 
traps placed on partitions Vn, ■ ■ ■ jVrf Thus, if (j42p does not hold for all 1 < £ < / then we would 
have 



\dHiA',Wu)-dHiB',Wu) 



f 

= dciA', Wu) - dciB', Wu) + Y.{de{A', Wu) - deiB', Wu)) 

1=1 
f 

> \dG{A!,Wu) - dG{B',Wu)\ - Y, \iddA',Wu)-diiB',Wu))\ 

e=i 

> 3'^-4/<52>|37|-<5>|38i7, 

where in the second inequality we use (f^TI) . Recalling (f33l) . (i39]l and (HO]l we thus infer that {Z, Zu) 
is not 7-regular which is a contradiction. ■ 

Assume that for each u for which (Z, Zu) is 7-regular, we set £„ to be the smallest integer for 
which ([12|) holds. Recall that ae^ is the weight added by the trap placed on the partition Vn ■ In 
the following subsection we prove Lemma 16.51 via Claim 16.71 (stated below) and in the subsection 
following it we prove this claim thus completing the proof of Lemma 16.51 



Claim 6.7. If (Z, Zu) is ^-regular, then either A' or B' satisfies the following two conditions (we 
write the condition with respect to A' ): 

• There is no X £ Vr, such that A' C X . 

. \d,S^,Wu)-\ai^\>28\ 

6.2 Proof of Lemma 16.51 via Claim 16.71 

Once again, let us recall that given Z <Zp Xi and Xj we are focusing only on the k/2m sets Zu C/j Xj 
such that (Z, Z„) are /3-helpful. We need to show that at least k/Am of the sets Zu are such that 
(Z, Zu) is not 7-regular. 

Suppose to the contrary that there are k/Am sets Zu for which (Z, Zu) is 7-regular. Then by 
Claim 16.71 for such Z„ either A' or B' satisfies the two conditions of Claim 16. 7[ Suppose without 
loss of generality that in at least fc/Sm of these cases the set is A' . Also, suppose without loss 
of generality that out of these k/8m cases, in at least k/l6m we have di^{A',Wu) > a^„/2 + 2(5^. 
Finally, since there are only / traps in the canonical partitions that refine Vr-i, we get that there 
must be an integer 1 < ^ < / for which there are at least k/16mf sets Wu for which the above 
holds such that iu = i- So for each of these sets we have 

de{A',Wu)>^ai + 26^ . (43) 
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For what follows we set S to be the collection of k/16mf values of u for which ()43p holds and such 
that 4 = i. 

We now make a simple observation which relates di{A' ,Wu), the graph 0^ that was used to 
define the trap which was placed on level Vr^ and the way in which A' and W are "spread" over the 
clusters of Vr^ Let m^^ denote the number of clusters of Vn (which is also the number of vertices 
of On ) • Let us use Yi, . . . , Ym^ to denote the clusters of Vn, ■ Suppose Xi and Xj each contain h 
clusters of Vn ■ 

Let x'^ £ [0, !]'"'■« be the vector satisfying Xp = |A' n y^|/|l^| for every 1 < p < m^^. Similarly, 
let j;" G [0, 1]™"'^ be the vector satisfying Xp = \Wu n y^|/|y^| for every 1 < p < nir^. If we take Q 
to be the adjacency matrix of O^ then 

*'•*■''"' -(E,=^?)(Ep-?)' <''> 

Our plan now is to show that the information we have gathered thus far contradicts Lemma 
14.51 Let us start setting the stage for applying this lemma. First, as partition Vb in Lemma 14.51 we 
will take partition Vn- So we are using m^^ as mf, in Lemma 14.51 

Second, as partition Vb' in Lemma 14.51 we will take partition Vr-i- Note that here and in 
Lemma 14.51 we use m to denote the number of clusters in partitions Vr-i and Vb' and that we use 
Xi, . . . , Xm to name the m clusters of both partitions. As 6 in Lemma 14.51 we use the same 6 used 
here, that is 5 = 4-^/4\/i°s(i/^) as defined in ([MD- We clearly have S < 1/200. Also, to satisfy the 
first condition of Lemma 14.51 we need to make sure that 5 > l/log(mr^), or equivalently that 



dr + VlogCl/e) 



-m ^'(^^) ^m nire/2\) > 2^'^^'-''^" =^ 2^^ , (45) 

We need to verify the second inequality. Recall that r^ > r since we are only considering traps that 
were placed on partitions refining Vr-i- Recalling ([3]) we also have r^ > loglog(l/e) since the first 
trap was placed on the partition with this index. It is easy to see that these two facts imply that 
the second inequality in (jl5]) indeed holds. 

As the vector x in Lemma 14.51 we will take the vector x° defined above, and as the vector y we 
take ^u^gx'^ with S the set defined just after equation (j43p . Note that since A' C Xi and for all 
u we have Wu ^ Xj , these vectors satisfy the second condition of Lemma 14.51 

Now, by Claim [6771 there is no clusteio X E Vr^ such that A' C X. By the process we have used 
to define A' , this means that each of the clusters of X € V^ contains no more than a 5^-fraction of 
the vertices of A' . This means that the vector x"" defined above satisfies the third item of Lemma 

sa 

Finally, observe that each of the sets Yp contains a l/m/i-fraction of H^s verticec^ while each 
set Zu takes a l//c-fraction. We thus get from ()33p that the sum of entries of each of the vectors x" 



^^Recall that we assume that £u = i for the set Wu with u £ 5. See the discussion at the beginning of this 
subsection. 

■^^Since each Xi contains a l/m fraction of ff' s vertices and we assumed that Xi is partitioned into h sets Yp. 
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is at least mh/Ak. Since we assume that there are at least k/16mf sets Wu, we infer that the sum 
of entries of y is at least h/QAf >|37l 25h. Hence y satisfies the fourth condition of Lemma 14.51 

Since we assume that each of the sets Wu satisfies ([15|) , we can use the formulation of dm to 
infer that 



c-f Qx" > (1/2 + 252) [y^xA [Y^^i] = (1/2 + 252)515- 



(46) 



where we set gi = ^ x^ and g'2 = Yl,p ^p- Now set 52 = J2p Vp — Ylu 92- Summing over all vectors 
x", and applying (|36|) we have 



v^fQy = {x^fQ ( ^ x" j > (1/2 + 25^) 9x^92 = (l/2 + 25^ 

\ u / u 



9192 



which contradicts (|12|) in Lemma W. 



6.3 Proof of Claim [6771 

We recall that we use ag to denote the weight added to H when placing a trap on partition Vn, 
and that for a set Wu we defined iu just before Claim [6771 

Claim 6.8. Set a = a^^. If \de^{A' ,Wu) - di^{B',Wu)\ > 0.4a then {Z,Zu) is not ^-regular. 



Proof: Recall that iu was chosen to be the smallest integer for which (j42p holds. Hence 



Y di{A! ,Wu) - d,{B\Wu) 
1=1 



^ ^f^' ^m TTii" 



100 



The assumption of this claim thus gives 

in 

YdiiA',Wu)-d,iB',Wu] 



e=i 



> 0.39Q 



Since the weights assigned to traps with weight smaller than a are given by a/4, a/16, . . ., after 
taking into account all the traps placed on Vn, ■ ■ ■ ,Vrf we still have 

/ 
YdM',Wu)-deiB',Wu) > 0.05a . (47) 

e=i 

As we have noted in the proof of Claim 16.61 the only traps that can create a discrepancy between 
dniA' ,Wu) and dniB' ,Wu) are those placed on Vm ■ ■ ■ j'Prf Hence we can disregard the traps 
that were placed on partitions refined by Vr-i, that is partitions other than Vn, ■ ■ ■ ^Vrf Thus, 
(I47|) holds even when considering all the traps placed in H. Finally, by Fact 12.51 the total weight 
assigned to edges in G is at most l/4v '°s(i/<:) <^^ O.Ola. We thus conclude that 

\dH{A', Wu) - dniB', Wu)\ > 0.04a >^ e > 7 . 

Recalling ([33]) . (j39]) and (|10]) we can deduce that {Z,Zu) is not 7-regular. ■ 
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Claim 6.9. // there is a cluster X € Vn such that A' (^ X and 

6^ < diiA', Wu) <ai-6\ (48) 

then (Z, Zu) is not ^-reaula'p^\. 

Proof: Let us define the vectors x° and x" as we have done just before equation ()44p . Let us 
also use the terminology used when defining these vectors. So X = Yg for some Yg <^ Xi implying 
that Xg = \A'\/\Yg\ and all the other entries of x" are 0. Suppose Yi, . . . , Y^ are the clusters of Vn 
within Xj. Let 0^. be the graph used when placing the trap on Vn, let Vg G V{0) be the vertex 
corresponding to cluster Yg and let ui, . . . ,Uh be the vertices corresponding to Yi, . . . , Yh. Finally 
set N = {p : {vg,Up) G E{0)} to be the indices of the vertices ui, ■ ■ ■ ,Uh which are neighbors of Vg 
in O. Then by dM]) and (jM]) we have 

S <—^ —<ae-5 , 

Z^p=i ^p 

implying that 

^2 < EpeN^; <i-5\ 

Z^p=l -^p 
This means that if we take VF^ = Wu n (UpeAf ^p) then 

6^\Wu\<\W^\<{l-8^)\Wu\. (49) 

Let VF'^ = Wu \ W^ and note that it satisfies (|49p as well. A critical observation now is that our 
choice of A^ implies that for all p E A the pair {Yg,Yp) belongs to the trap placed on Vn and for 
all p ^ N the pair {Yg,Yp) does not belong to this trap. This means that d£{A' ,W^) = a^ while 
de{A',W^) = 0. 

We win now show that we can find W' C W^ and W" C W'^, satisfying \W'\ > €^^^'^\W^\, 
\W"\> e^/^^\W^\ and 

\dH{A',W')-dH{A',W")\>j. (50) 

Recalling (j39p . this will imply that {Z, Zu) is not 7-regular as the fact that \W'\ > e^' ^'^[VF^I means 
that 

where in the fourth inequality we use the fact that 7 < e. A similar derivation would show that 

\W"\>j\Zu\. 



^^Note that in this claim we are not assuming that £ = £u- That is, the claim is true for all 1 < ^ < /. However, 
we will only apply it with £ — £u- 
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So we are left with picking the sets W and W" . Let us focus on W' . Consider some 1 < 



< 



Since we assume that A' is contained is one of the clusters of Vn there must be a cluster Y^ G Vr^, 
such that A' C Y' Take some p G N and let Y' G Vr,, be the cluster containing Yp. So we see that 
for each pair {Yq,Yp), either all the vertices {x,y) £ Yq x Yp get an extra weight of a^/ from that 
trap or none of them do (depending on whether {Y^, Yp) belongs to the trap placed on Vr^,)- So for 
each pair (Yg, Yp) there is a subset Sp C [£ — 1] representing those traps from which {Yg,Yp) got an 
extra weight. Recall now that H contains only ^y^log(l/e) many traps, so there are (much) less 
than 1/e^'^^ ways to pick a set Sp CI [^ — 1]. So there must be a subset N' <^ N such that Sp = Spi 
for all p,p' G A^' and such that \W^ n Upejv' ^pl ^ e^^^°\W^\- We now take W' = W^ n Upe^v' ^p 
and take S' to be the subset of [i — 1] which is common to all p G N'. Recapping the above, we see 
that iff G S' then di>{A', W) = a^ and iff S' then di,>{A\ W') = id. We can now define W" and 
S" in a similar way, such that if f G S" then dt{A\ W") = ae and if f S" then de{N, W") = 0. 
If S' = S" set f = £, otherwise, let f be the smallest index that appears in exactly one of 
the sets 5' and S" . Also, set a = a^i. Let us now compare du^A' ,W') and dniA' ^W"). By our 
choice of a, the traps with weight larger than a have the same contribution to both d}i{A\W') 
and dniA' , W"). Using again the way we chose a we get that 



^d,{A',W')-d,{A',W"] 



a 



Now observe that the total weight added by traps with weight smaller than a is bounded by 
a/4 + a/16... < a/3. So after taking into account all traps Vn, ■ ■ ■ j'Prf there is still a discrepancy 
of at least 



/ 



^de{A',W')-de{A',W": 



e=i 



> a/2 



As in previous proofs, we do not need to consider the weight coming from traps not placed on 
Vri, ■ ■ ■ j'Prf (that is, traps placed on partitions refined by Vr-i) since A' O Xi £ Vr-i and 
Wu ^ Xj G "Pr-i- Finally, by Fact 12.51 the total weight assigned to edges in G is bounded 
by l/4v i°g(i/"^) <|35i a/4, so after taking into account all the weights assigned to {A' ,W') and 
{A\W") in i/ we still have 

\dH{A', W) - dniA', W")\ > a/4 >^ e > 7 • 

This proves (j50p thus completing the proof. ■ 

Claim 6.10. // there is a cluster X G Vn such that A' C X and a cluster Y G Vn such that 
B' QY then (Z, Z^) is not ^-regular. 



Proof: If either A' or B' satisfies (|48p then Claim [6^ implies that {Z,Zu) is not 7-regular. So 
suppose both do not satisfy (jl8|) . Now note di^ {A' , Wu), di^ {B' , Wu) < ai^ since ai is the maximum 
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weight a pair of sets can get from the trap placed on Vrg- Recah that £« is an integer for which 
(j42p holds hence one of the sets (say A') satisfies < d(,^{A\Wu) < 5^ while the other satisfies 
a£^ — 5"^ < d£^{B', Wu) < a^„- But this means that 

\deM',Wu) - deAB',Wu)\ > «,„ - 26^ >^ a,j2 , 
so {Z, Zu) is not 7-regular by Claim [6^81 ■ 



We are now ready to complete the proof of Claim 16.71 We know from Claim 16.101 that one of 
the sets A' or B' must satisfy the first requirement of the claim. Suppose it is A' . If A' also satisfies 
the second item then we are done, so suppose it does not. 

If B' also satisfies the first requirement of the claim, then since iu is chosen to satisfy (j42p and 
since we assume that A' does not satisfy the second requirement of the lemma, we get that B' must 
satisfy the second requirement and we are done. 

So suppose now that the B' does not satisfy the first item. If 6'^ < d^^{B\ Wu) < «£„ — (^^ then 
by Claim [6T9l (Z, Zy) is not 7-regular, which contradicts the assumption of Claim [6?71 that (Z, Zu) 
is 7-regular. Finally, if either di^{B' , Wu) > «£„ — S'^ or de^{B', Wu) < 5^ we can combine this with 
the assumption that A' does not satisfy the second requirement of the claim to get that 

\d,^iA',Wu) - de^{B',Wu)\ > \a,^ - 36' >^ 0.4a,„ . 

Claim 16.81 then implies that {Z,Zu) is not 7-regular which again contradicts the assumption of 
Claim E21 

Note added. After completing this paper, we learned that D. Conlon and J. Fox have indepen- 
dently (and simultaneously) obtained a result similar to the one stated in Theorem [3l Their proof 
gives a lower bound of W{l/e'^) for some c > to the strong regularity lemma. 
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